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Abstract 

Background: Indirect reciprocity is a mechanism for cooperation in social dilemma situations. In indirect reciprocity, 
an individual is motivated to help another to acquire a good reputation and receive help from others afterwards. 
Another aspect of human cooperation is ingroup favoritism, whereby individuals help members in their own group 
more often than those in other groups. Ingroup favoritism is a puzzle for the theory of cooperation because it is not 
easily evolutionarily stable. In the context of indirect reciprocity, ingroup favoritism has been shown to be a 
consequence of employing a double standard when assigning reputations to ingroup and outgroup members. An 
example of such a double standard is the situation in which helping an ingroup member is regarded as good, 
whereas the same action toward an outgroup member is regarded as bad. 

Results: We analyze a computational model of indirect reciprocity in which information sharing is conducted 
groupwise. In our model, individuals play social dilemma games within and across groups, and the information about 
their reputations is shared within each group. We show that evolutionarily stable ingroup favoritism emerges even if 
all the players use the same reputation assignment rule regardless of group (i.e., a single standard). Two reputation 
assignment rules called simple standing and stern judging yield ingroup favoritism; under these rules, cooperation 
with (defection against) good individuals is regarded as good (bad) and defection against bad individuals is regarded 
as good. Stern judging induces much stronger ingroup favoritism than does simple standing. Simple standing and 
stern judging are evolutionarily stable against each other when groups employing different assignment rules 
compete and the number of groups is sufficiently large. In addition, we analytically show as a limiting case that 
homogeneous populations of reciprocators that use reputations are unstable when individuals independently infer 
reputations of individuals, which is consistent with previously reported numerical results. 

Conclusions: Our results suggest that ingroup favoritism can be promoted in indirect reciprocity by the groupwise 
information sharing, in particular under the stern judging assignment rule. 



Background 

Behavioral nature of humans depends on the economy 
of reputations, where praise and blame often lead to 
gain and loss of material benefits [1,2]. Humans, among 
other animals, cooperate via indirect reciprocity, which 
involves cooperation beyond pairwise relationships [3-6]. 
In indirect reciprocity based on reputations, an indi- 
vidual acquires a good reputation by behaving coopera- 
tively in apposite situations. The cost of maintaining a 
good reputation is compensated for by other individuals' 
future cooperation toward the individual possessing the 
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good reputation. Indirect reciprocity has been extensively 
studied in both theories [5-19] and experiments [2,20-23]. 

Another facet of human cooperation is that an individ- 
ual often cooperates with members in the same group and 
not with others, a phenomenon called ingroup favoritism 
[24-33]. Ingroup favoritism poses a puzzle for the theory 
of cooperation because it is usually not Pareto efficient; 
i.e., the payoff to an individual in the case of ingroup 
favoritism is smaller than that in the case of group- 
independent all-out cooperation. In addition, an individ- 
ual implementing ingroup favoritism is worse off than 
an individual defecting against both ingroup and out- 
group members unless a specific assumption is imposed. 
In fact, known mechanisms for stable ingroup favoritism 
(e.g., correlation between altruistic traits and phenotypic 
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tags [34-36], incomplete observability of tags [37], com- 
bination of mutation of tags and limited dispersal [38]) 
are, in our view, complicated. Otherwise, stable ingroup 
favoritism requires an additional mechanism (e.g., inter- 
group conflict [39,40]) that is capable of stabilizing coop- 
eration on its own. 

If maintaining a good reputation is a concern, why do 
individuals want to discriminate between ingroup and 
outgroup fellows? One of the present authors has shown 
that ingroup favoritism is evolutionarily stable in various 
situations when only group-level reputations are avail- 
able in regard to outgroup members [41]. In the model, 
an individuals action changes the individuals reputation 
in the eyes of the ingroup members, and the action also 
changes the reputation of the group to which the individ- 
ual belongs. It was revealed that the action rule of individ- 
uals (i.e., the strategy depending on the reputation of the 
coplayer) toward ingroup and outgroup members and the 
reputation assignment rule (also called the social norm) 
used for evaluating ingroup and outgroup interactions, or 
at least the latter, must discriminate between ingroup and 
outgroup members for stabilizing ingroup favoritism. An 
example is a rule whereby cooperation toward outgroup 
members is frowned upon, whereas the same behavior 
toward ingroup members leads to a good reputation. Con- 
sistent with this theoretical example, Yamagishi and col- 
leagues had conducted behavioral experiments suggesting 
that ingroup favoritism occurs because subjects anticipate 
that the reputation mechanism is functional only inside 
the group [25-27,29,33]. These theoretical and experi- 
mental results suggest that double standards, in terms of 
the action rule or the reputation assignment rule, may 
underpin ingroup favoritism. 

In the context of indirect reciprocity, group struc- 
ture may play a crucial role in spreading reputations 
of individuals via rumor and gossip. In general, indi- 
viduals interact more frequently with ingroup members 
than with outgroup members [42] . Therefore, rumor and 
gossip may enable sharing of reputations of individuals 
more smoothly within a group than between different 
groups. Most theoretical studies of indirect reciprocity 
have assumed that information sharing and interactions 
occur randomly in a well-mixed population. Otherwise, 
individuals are assumed to not exchange information 
about reputations [7,10,13,19]. 

In the present study, we explore a scenario of ingroup 
favoritism without resorting to rules that apply dou- 
ble standards. In practice, humans may not differentiate 
between ingroup and outgroup coplayers with regard to 
their action rules or reputation assignment rules. We 
analyze a group-structured model of indirect reciprocity, 
in which an individuals reputation is shared by each 
group but not between groups. We study the case in 
which all the players use the same reputation assignment 



rule and the case in which players in different groups 
use different reputation assignment rules. We show that 
ingroup favoritism can emerge when players simply 
implement reputation-based decision making and do not 
favor ingroup members. Because of the assumed group- 
wise information sharing and some reputation assignment 
error, ingroup and outgroup members tend to possess 
good and bad reputations, respectively, without further 
assumptions. In particular, ingroup favoritism is strong 
when individuals adopt a reputation assignment rule 
called stern judging, under which helping bad individuals 
is regarded as bad. 

Methods 

Model 

We consider an infinitely large population of players 
divided into M (> 2) groups. Each group is assumed to 
contain the equal fraction, 1/M, of players. In the pop- 
ulation, players are involved in sufficiently many rounds 
of the so-called donation game. In a one-shot donation 
game, two players are randomly selected from the popula- 
tion, one as donor and the other as recipient. We assume 
that the donor and recipient belong to the same group 
with probability 0. The donor cooperates (C), i.e., provides 
help, or defects (D), i.e., refrains from helping, depending 
on the donors action rule and the recipient s reputation 
(good (G) or bad (B)). Action C imposes cost c (> 0) on the 
donor and results in benefit b (> c) imparted to the recip- 
ient. Action D does not change the payoff to either the 
donor or recipient. A donor adopting action rule ALLC 
cooperates with any recipient. A donor adopting action 
rule ALLD defects against any recipient. A donor adopting 
action rule DISC cooperates with G recipients and defects 
against B recipients. 

To know a recipients reputation, the donor consults 
the unique information source, called the observer, that is 
shared by the group to which the donor belongs. There- 
fore, players in different groups may perceive different 
reputations (i.e., G or B) of the same player. The observer 
in each group independently assigns a reputation to the 
donor and shares it with the other players in the observers 
group. Observers intend the predefined reputation assign- 
ment toward a donors action but may assign a reputation 
opposite to the intention. The M observers independently 
commit such assignment error with probability fi (<^C 1). 
In the example of intragroup interaction shown in 
Figure 1, all the three observers intended to assign G to 
the donor, and one observer erroneously assigned B to the 
donor. If the assignment error occurs, the "wrong" repu- 
tation is shared by all the players in the group to which the 
observer belongs. 

Observers assign reputations according to a com- 
mon reputation assignment rule unless otherwise stated. 
We principally compare three rules: image scoring 
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Figure 1 Behavior of different observers in different groups 

(M = 3). 



(IM), simple standing (ST), and stern judging (JG) 
[5,6,10-12,14,18], symbolically shown in Figure 2. Among 
the three rules, IM is the simplest rule under which 
observers assign G and B to a donor that has selected C 
and D, respectively. ST and JG are simplest among the 
so-called "leading eight" reputation assignment rules that 
stabilize cooperation in well-mixed populations [11,12], 
Under ST and JG, the new reputation of the donor 
depends on the action of the donor (i.e., C or D) and the 
reputation of the recipient (i.e., G or B). When a recipient 
has a G reputation, observers assign G and B to a C and D 
donor, respectively, under both ST and JG. When a recip- 
ient has a B reputation, observers assign G to a D donor 
under both rules. The two rules are different in that help- 
ing bad individuals (i.e., a donors C with a B recipient) is 
appreciated (i.e., G imparted by the observer) under ST, 
whereas the same action of the donor is punished (i.e., B 
imparted by the observer) under JG; JG is sterner than ST 
[1,18]. 

After sufficiently many rounds of the donation game 
involving reputation updates, the reputation distribution 
in the eyes of each group-specific observer reaches a 
unique equilibrium. In the equilibrium, we measure the 
quantities of interest such as the fractions of G players, 
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Figure 2 Three reputation assignment rules. Image scoring (IM), 
simple standing (ST), and stern judging (JG). The rows represent the 
donor's actions (i.e., C and D), the columns represent the recipient's 
reputations (G and B), and G and B inside the boxes represent the 
reputations that observers assign to the donor. 



the probability of cooperation, and their dependence on 
groups. 

Analysis methods 

Equilibria of the reputation dynamics 

Table 1 summarizes the definitions of the symbols used in 
this section. 

We examine the stability of a homogeneous population 
of DISC players. Each player bears a reputation vector, 
r = (n, r2, . . . , tm) £ {G, B} M , in the eyes of M observers, 
each representing a group. We denote by pk(r) the prob- 
ability that a player in group k has reputation vector r. 
By adopting the formalism developed by Ohtsuki & Iwasa 
[11], we obtain the following reputation dynamics: 



dt 



Pk(r) = -p k (r) + {°Pk(r f ) + (1 - 0)p-k(/)} 



r'e{G,B} M 

Y\<S> rk ,(a(r' k ), r ' k ,). 



M 



k'=l 



(1) 



The summation on the right-hand side of Eq. (1) repre- 
sents the average over the recipient s reputation vector r' . 
With probability 0, a game involves a donor and a recipi- 
ent in group /<, and the recipient has reputation vector r' 
with probability p k {r^). With probability 1 — 6,3. donor and 
a recipient belong to group h and another group, respec- 
tively, and the recipient has reputation vector r' with 
probability p_ k (/) = Y!$=i,k^kPk>(r')/{M - 1). o{r' k ) 
represents a donors action toward a recipient having rep- 
utation r' k . Because we assume DISC donors, cr(G) = C 

Table 1 Meaning of symbols 

Symbol Meaning 

M Number of groups 

6 Probability that a donor and recipient in a 

one-shot game are in the same group 



r e {G, B} M 

Pkir) 
P-kir) 

cr(r) e {C, D} 
PinOO 

PoutiO 



Reputation vector of a player in the eyes of M 
observers 

Probability that a player in group k has repu- 
tation vector r 

Probability that a player outside group k has 
reputation vector r 

Donor's action to a recipient having reputa- 
tion r e {G, B} 

Probability that an observer assigns reputa- 
tion r e {G, B} to a donor selecting action 
a e {C, D} to a recipient having reputation 
r' e {C, D} 

Probability that a player in the eyes of an 
ingroup observer has reputation r 

Probability that a player in the eyes of an 
outgroup observer has reputation r 
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and cr(B) = D. The reputation assignment rule is essen- 
tially given by (<r(rp, r f k ,) e {1 — /x, /x}, which is the 
probability that an observer in group 1<! assigns reputa- 
tion r k t to a donor in group k. This probability depends on 
the donors action cf(r' k ) toward a recipient having repu- 
tation r' k , in the eyes of the observer in each group k f . In 
Table 2, we list the O values under different assignment 
rules. It should be noted that all the observers use a unique 
assignment rule unless otherwise stated; we do not basi- 
cally assume that observers employ different assignment 
rules as in previous studies [10,15,16,18,19]. 

We reduce Eq. (1) to mean field dynamics of two rep- 
utation distributions. First, we apply summation k = 

En E n --- Ern E rk+1 ---Eru to both sides of Eq. (1) 
to obtain the reputation dynamics in the eyes of ingroup 
observers as follows: 



d 
dt 



Pin(r) = -Pin(r)+ {^inC^ + a-^out^)} 

r'G{G,B} 



(2) 



where p in (r) = J2r_ k Pk( r ) and^ O ut0) = J2r_ k P-k( r ) are 
the probabilities that a player has reputation r e {G, B} in 
the eyes of ingroup and outgroup observers, respectively. 
The two terms inside the curly brackets on the right-hand 
side of Eq. (2) correspond to the two situations shown in 
Figure 3(a) and (b). With probability Op- m {r f ), the recipient 
belongs to the donor and observers group, and has rep- 
utation r' (Figure 3(a)). With probability (1 - 0)p out (r f ), 
the recipient does not belong to the donor and observer's 
group, and has reputation r' (Figure 3(b)). 
Second, by applying summation Y<r- t = H n Y.r 2 • • • 

Er £ _! Er m ' ' ' Er M ' where 1 ^ /c ' t0 b ° th sideS ° f Ec l' 

we obtain 



dl " r' k e{G,B} r' e e{G,B} 1 

h) 



M-l 



Pdr'r' t ) + [l 



M 



(3) 



Table 2 Probability that an observer assigns G to a donor 



Rule 


*g(CG) 


*g(D, G) 


<MCB) 


*g(D, B) 


IM 


1 — jJL 


11 


1 — [i 


[1 


ST 


1 -n 


\1 


1 -n 


1 -n 


JG 


1 -fi 


li 


11 


1 -n 



Og {a, r) represents the probability that a donor receives G when the donor 
selects action a e {C, D} and the recipient has reputation r e {G, Bj.The donor 
receives B with probability O b (a, r) = 1 — Oc(o,r). 



where p k (/ k , ^), pi(/ k , r f t ), and p-u(/ k > r f t ) are the proba- 
bilities that a player in group /<, group £, and a group other 
than k and I, respectively, has reputation r' k and in the 
eyes of observers in groups k and L By approximating the 
three probabilities by Pm(^ k )p 0 ut(^), Ponti^Pin^), and 
Pout(r' k )Pout(r f £)> respectively, we obtain the mean-field 
reputation dynamics in the eyes of outgroup observers as 
follows: 



d 
dt 



Poutir) = - Pout(r) + ^ ^ \0pi n (r f )p out (r ff ) 

r / €{G,B}r // e{G,B} 



+ (1-0) 



l 



M-l 



PoMt(r')p-m(r") 



+ (l - j/zrj) Pout(r')Pout(r") 
x O r (cr (/),/')• 



(4) 



The three terms inside the curly brackets on the right- 
hand side of Eq. (4) correspond to the three situations 
shown in Figure 3(c), (d), and (e). With probability 
Opin(r')Pou.t(r")> the recipient belongs to the donors 
group, which differs from the observers group, and 
has reputation r' and r" in the eyes of the donor 
and observer, respectively (Figure 3(c)). With probability 
(1 - 0)[ l/(M- 1)] p 0 \it(r f )Pm(r")> the recipient belongs to 
the observers group, which differs from the donor s group, 
and has reputation r' and r" in the eyes of the donor and 
observer, respectively (Figure 3(d)). With probability (1 — 
0)[ 1 - 1/(M — 1)] p 0 ut(r')Pout(r")> the recipient belongs to 
a group different from the donors and observers groups, 
and has reputation r' and r" in the eyes of the donor and 
observer, respectively (Figure 3(e)). 

By setting dp m (r)/dt = dp out (r)/dt = 0 in Eqs. (2) 
and (4), we identify stationary points that are candidates 
of stable equilibria of the reputation dynamics. We exam- 
ine the conditions det/ > 0 and Tr / < 0, where / is 
the Jacobian matrix, at each stationary point to identify all 
the stable equilibria. We confirmed that the stable equilib- 
rium denoted by p* n (r) and p% ut (r) * s unique under each 
reputation assignment rule. 

Stability against invasion byALLC and ALLD mutants 

We check the evolutionary stability of a homogeneous 
population composed of DISC players against invasion by 
an infinitesimal fraction of mutants adopting ALLC or 
ALLD. The payoff to a DISC resident player is given by 

ttdisc = (b-c) [Opl(G) + (1 - 0)p* out (G)] , (5) 

and those to ALLC and ALLD mutants are given by 

7TALLC = -c + b [0pg(G) + (1 - 0)/£ t (G)] (6) 
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(a) 





(^) Donor 
(^) Recipient 
Observer 




(e) 




Figure 3 Five possible situations of the reputation update. Observations are made by ingroup observers in (a) and (b), and by outgroup 

observers in (c), (d), and (e). 



and 



7TALLD = b [0 P ? n (G) + (1 - d)A(G)] , 



(7) 



respectively. In Eqs. (6) and (7), pg(G), /& t (G), p? (G), 
and ^ ut (G) represent the probabilities that the mutants 
selecting C and D acquire G reputations in the eyes of 
ingroup and outgroup observers, and are given by 

Kn(G)= E {Opl(r f ) + (l-0)pl ut (r f )}<!> G (a,r f ) 

r'e{G,B} 

and 

Kut(G)= E E {^rn(^>out(^") + (i-^) 



r'e{G,B} r"e{G,B} 
1 



X 



X Kut^out^')]}^^/'), 

where a = C or D. The population of DISC players is 
stable against invasion by ALLC and ALLD mutants if 



7TDISC > max {7TALLO ^ALLd} « 



(8) 



Cooperativeness 

DISC donors cooperate exclusively with G recipients. 
Therefore, in each stable equilibrium, the probability of 
cooperation, which we call the cooperativeness, toward 
ingroup and outgroup recipients is given by p* n (G) and 
Po Ut (G), respectively. The cooperativeness for the entire 
population is given by 



Measurement of ingroup bias 

To quantify the degree of ingroup bias, we measure the 
difference between ingroup and outgroup cooperative- 
ness, denned by 



P =Pin( G ) -^out( G )- 



(10) 



(9) 



When p & —1, players basically cooperate with outgroup 
recipients and defect against ingroup recipients, imply- 
ing outgroup favoritism. When p « 0, players equally 
likely cooperate with ingroup and outgroup recipients. 
When p & 1, players cooperate with ingroup recipients 
and defect against outgroup recipients, implying ingroup 
favoritism. 

Results 

Table 3 summarizes the results obtained under the three 
reputation assignment rules. It shows the stable fractions 
of G players in the eyes of ingroup and outgroup observers 
(i.e., p* n (G) and j^* ut (G)), the stability conditions, coop- 
erativeness (i.e., x/r), and the degree of ingroup bias 
(i.e., p). 

IM 

Under IM, the equilibrium fractions of G players in the 
eyes of ingroup and outgroup observers are both equal to 
iff = 1/2. Therefore, ingroup favoritism does not occur, 
i.e., p = 0. Furthermore, the population of DISC players 
is invaded by ALLC mutants such that it is unstable. This 
result is consistent with the established result that coop- 
eration is usually unstable under IM because observers do 
not distinguish between selfish defection (i.e., D against 
G recipients) and justified defection (i.e., D against B 
recipients) [1,8,10,43]. 
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Table 3 Equilibria and the stability conditions for a population of DISC players under different assignment rules 



Rule 




PSutW) 


Stability condition 


iff 




IM 


1 

2 


1 

2 


Unstable 


1 

2 


0 


ST 


1 -fl 


1 +0(/x 2 ) 


Eq. (14) 


1 - £ + 0(/x 2 ) 


f +0(/x 2 ) 


JG 


1 -n 


1 

2 


Eq. (18) 







ST 

Under ST, DISC players almost always cooperate with 
ingroup recipients, i.e., p* n (G) = 1 — /x. This result is 
consistent with the previous results in which ST enables 
perfect cooperation when a population does not possess 
group structure (corresponding to M = 1) [11,12]. 

The fraction of G players in the eyes of outgroup 
observers is given by 

p* ut (G) = l-/x^ + 0(/x 2 ). (11) 

Therefore, DISC players almost always cooperate with 
both ingroup and outgroup recipients unless 0 is small 
(i.e., yjr = 1 — /jl/0 + 0(/x 2 )). Because donors defect 
slightly more often against outgroup than ingroup recip- 
ients, weak ingroup favoritism occurs (i.e., p = \i/0 + 
0(/x 2 )). 

Equations (5), (6), and (7) yield the payoff differences 
given by 

7TALLC " 7TDISC = J [Hi ~ 0) - c] + 0(/X 2 ) (12) 

and 

7TALLD - 7TDISC = ~(* ~ c) + 0(/x). ( 13 ) 

Therefore, the stability condition (Eq. (8)) reads 
hi 

1 < - < ^—r. (14) 
c 1 — 0 



ALLC mutants invade DISC players if b/c > 1/(1 — 0). 
The cooperation is stable up to a large value of b/c 
when ingroup interaction is frequent (i.e., large 0). ALLD 
mutants invade a DISC population under a trivial condi- 
tion b/c < 1. 

JG 

Under JG, DISC players have the same cooperativeness 
toward ingroup recipients as under ST, i.e., j?* n (G) = 1— /x. 
This result is consistent with the previous results in which 
JG enables perfect cooperation when a population does 
not possess group structure (corresponding to M = 1) 
[11,12]. 

The fraction of G players in the eyes of outgroup 
observers is given by 

1 



Kut(G) = 



(15) 



Therefore, DISC players cooperate with outgroup recip- 
ients with probability 1/2. In contrast to the case of ST, 



frequent intergroup interaction considerably reduces 
cooperation under JG (i.e., iff = (1 + 0)/2 + /jlO). The 
degree of ingroup bias under JG is given by p = 1/2 — /x, 
which is independent of 0. DISC players show a signifi- 
cant level of ingroup favoritism, even though they simply 
use the reputations without intending to discriminate 
recipients by the group identity. 
The payoff differences are given by 



^ALLC - ^DISC = 



MO 



M — 1 



+ c 



+ 0(/x) (16) 



and 



^"ALLD-^DISC 



-IP 



+ (M-3)0+M0 2 



M — 1 



-c(l + 0) 



+ 0(/x). 



The stability condition reads 

(M — 1)(1 + 0) b M — 1 
1 + (M - 3)0 + MO 2 < c < 1 - MO 



(17) 



1 



if 0 < 0 < — , 
M 



(Af-l)(l + fl) 
l + (M-3)6>+M6> 2 



ifl< 

M ~ 



< 1. 
(18) 



The DISC population is resistant to invasion by ALLC 
mutants when 0 > 1/M, i.e., when ingroup interaction 
occurs more frequently than in the case of unbiased ran- 
dom pairing. When 0 < 1/Mandb/c > (Af-1)/(1-Af0), 
ALLC mutants invade the population of DISC players. 
When b/c < (M - 1)(1 + 0)/[ 1 + (Af - 3)0 + MO 2 }, 
ALLD mutants invade the population of DISC players. 
The cooperation is stable down to a small value of b/c if 
ingroup interaction is frequent (i.e., large 0) or the number 
of groups (i.e., M) is small. In the limit M — ► oo, Eq. (18) 
is reduced to b/c > I/O, which coincides with the results 
obtained from a previous model with infinite groups [41]. 

Under both ST and JG, in particular JG, ingroup 
favoritism emerges. This is because the donors (equiv- 
alently, ingroup observers) and outgroup observers gen- 
erally perceive different reputations of the same player 
due to the assignment error (see Figures 1, 3(c), 3(d), and 
3(e)). For example, if a donor defects against a recipient 
whose reputation is B in the eyes of the donors group 
members, the donor receives a G reputation from the 
ingroup observer. However, if the same recipient has a G 
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reputation in the eyes of the outgroup observer, the out- 
group observer assigns B to the donor under ST and JG. 
As another example, if a donor cooperates with a recip- 
ient whose reputation is G in the eyes of the donor s 
group members, the donor receives G from the ingroup 
observer. However, if the recipient has a B reputation in 
the eyes of the outgroup observer, the outgroup observer 
assigns B to the donor under JG. As these examples sug- 
gest, different groups may perceive the opposite reputa- 
tions of the same players in a long run. Players in the same 
group coordinate the subjective information about a given 
players reputation, whereas those in different groups do 
not. This discrepancy causes ingroup favoritism. 

Numerical results 

We compare the theoretical results with numerical results 
obtained from individual-based simulations in Figure 4. 



The procedure of the numerical analysis is described in 
Appendix A. The analytical and numerical results are 
sufficiently close to each other in terms of both coopera- 
tiveness (Figure 4(a)) and ingroup bias (Figure 4(b)). 

We also examine the error-prone case in which donors 
fail to help recipients (i.e., select D when the donors 
intend C) with probability 6 [9]. The numerical results 
for 6 = 0.01 and 0.1 are shown in Figure 5. The error 
reduces cooperativeness (Figure 5(a)) and ingroup bias 
(Figure 5(b)) under both ST and JG (see Figure 4 for the 
error- free case). Nevertheless, the results with the error 
are qualitatively the same as those without the error. 

Mixed assignment rules 

We have shown that JG leads to strong ingroup favoritism, 
whereas ST does not. To examine the transition between 
the two regimes, we consider an assignment rule denoted 
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Figure 4 Equilibria for a population of DISC players under ST and 

JG. (a) Cooperativeness and (b) ingroup bias (p). We vary the 
assignment rule (ST or JG), the number of groups (M = 2 or 10), and 
the probability of ingroup interaction (0).The lines represent 
theoretical results shown in Table 3. The symbols represent numerical 
results. 
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by MX, which is a mixture of JG and ST. In a one-shot 
game under MX, observers independently assign reputa- 
tions by using JG with probability a and ST with probabil- 
ity 1 - a. Therefore, Og(C, G) = 1 - /x, <&g(D,G) = /x, 
O g (C,B) = ctfi + (1 - o0(l - /z), and O g (D,B) = 
1 — [A. Parameter a controls the degree of sternness 
with which observers assign B to donors that cooperate 
with B recipients. ST and JG correspond to a = 0 and 
a = 1, respectively. We numerically solve Eqs. (2) and (4) 
under MX. 

The results under MX are shown in Figure 6. Stern- 
ness gradually decreases cooperativeness (Figure 6(a)) and 
increases ingroup bias (Figure 6(b)) for different values of 
M and 0. The results interpolate those for ST and JG and 
imply that sternness promotes ingroup favoritism. The 
shaded parameter regions in Figure 6(c)-(f) indicate the 
values of a and b/c for which DISC residents are stable. 
Above (below) the shaded regions, ALLC (ALLD) mutants 
invade the DISC population. In all the cases, the upper 
and lower bounds of the stability region in terms of b/c 
increase with a. A decrease in M induces cooperativeness 
and reduces ingroup bias. A decrease in M also broadens 
the stability regions if 0 is large. An increase in 0 induces 
cooperativeness, reduces ingroup bias, and broadens the 
stability regions for the following reason. When 0 is large, 
players are largely involved in ingroup interactions. Then, 
they do not suffer from a B reputation that outgroup 
observers may frequently attach to the donor because of 
the discrepancy between players' reputations perceived by 



different groups (see subsection JG in Results for related 
discussion). 

Heterogeneous assignment rules 

We have assumed that all the groups use a common rep- 
utation assignment rule. In this section, we numerically 
examine a case in which observers in different groups use 
different reputation assignment rules. We consider a situ- 
ation in which m (1 < m < M — 1) groups use JG and 
M — m groups use ST. The procedure of the numerical 
analysis is described in Appendix B. 

Numerically obtained equilibria with M = 8 and 
M = 20 are shown in Figure 7(a) and (b), respectively. As 
the number of JG groups (i.e., m) increases, the coopera- 
tiveness (t/^st and xJ/jg for ST and JG groups, respectively) 
decreases, and ingroup bias (pst and pjc for ST and JG 
groups, respectively) increases. Figure 7(c) and (d) shows 
the difference between the payoff to a player in a ST 
group and that to a player in a JG group (i.e., 7Tjg — ttst) 
when M = 8 and M = 20, respectively. When the benefit- 
to-cost ratio is small (i.e., b = 2), 7Tjg — ttst is posi- 
tive. Therefore, if observers update their assignment rules 
according to an evolutionary dynamics (e.g., group com- 
petition [16]), the evolutionary dynamics would lead to a 
homogeneous population in which all the observers adopt 
JG. When the benefit-to-cost ratio is large (i.e., b = 6), 
K]G — ^ST is positive when m is large and negative when 
m is small. This implies that a homogeneous popula- 
tion of ST and that of JG are bistable under evolutionary 
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Figure 6 Equilibria and the stability conditions for a population of DISC players under MX. (a) Cooperativeness and (b) ingroup bias (p). 
In (a) and (b), we set (M, 6) = (2, 0.6), (oo, 0.6), (2, 0.2), and (oo, 0.2). (c)-(f) Stability conditions. The homogeneous population of DISC players is 
stable in the shaded parameter regions. We set (c) (M, 9) = (2, 0.6), (d) (M, 9) = (oo, 0.6), (e) (M, 9) = (2, 0.2), and (f) (M, 9) = (oo, 0.2). 
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Figure 7 Equilibria for a population of DISC players under heterogeneous assignment rules, (a), (b) Cooperativeness (t/^st and ^jg) and 
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dynamics. The basin of attraction for the homogeneous 
ST population in terms of m broadens as b increases. 
When the benefit- to-cost ratio takes an intermediate value 
(i.e., b = 4), the results for M = 8 (Figure 7(c)) and those 
for M = 20 (Figure 7(d)) are qualitatively different. For 
M = 8, 7Tjg — ttst is negative only when m = 2 or 3. 
Therefore, a stable mixture of ST and JG groups and a 
homogeneous population of JG are bistable. ForM = 20, a 
homogeneous population of ST and that of JG are bistable. 

Discussion 

In the present study, we showed that ingroup favoritism 
emerges in a group-structured model of indirect reci- 
procity. In our model, players share information about 
reputations in each group but not across different groups. 
We assumed that a players action purely depends on the 
coplayers reputation; players do not refer to the group 
identity of the coplayers or use other types of preju- 
dice. We also assumed that observers impartially assess 
ingroup and outgroup donors. We analyzed the model 
using a mean-field approximation and numerical sim- 
ulations. Ingroup favoritism occurs under both simple 
standing (ST) and stern judging (JG) assignment rules. 
The cooperativeness is reduced by the frequent intergroup 
interactions, i.e., small 0. The ingroup bias is severer and 
the cooperativeness is smaller under JG than under ST. 



The parameter region for the stability of the cooperative 
equilibrium is larger under JG than under ST. Under ST 
and JG, a population of discriminators is evolutionarily 
stable if the probability of ingroup interaction (i.e., 0) is 
sufficiently large. If 6 is small, the population is invaded 
by unconditional cooperators and unconditional defectors 
under ST and JG, respectively. We also studied the case 
in which observers may adopt different assignment rules 
in different groups. We found that JG would dominate ST 
in evolutionary settings when the benefit-to-cost ratio is 
small. Otherwise, the homogeneous population in which 
all the groups employ ST and that in which all the groups 
employ JG are bistable in large parameter regions. 

Different mechanisms govern ingroup favoritism in our 
model and that observed in psychological experiments 
[24-33]. In the latter, players use a cue that indicates the 
group identity of the coplayer and preferably cooperate 
with ingroup members. In our model, players do not refer 
to the group identity of the coplayer. They show ingroup 
favoritism because they perceive that outgroup mem- 
bers have bad reputations more often than do ingroup 
members. 

We implemented the group structure by controlling 
probabilities of ingroup and outgroup interactions (i.e., 
6 and 1 — 6, respectively) and assuming the group- 
wise information sharing. In terms of the structure of 
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information sharing, most previous theoretical studies of 
indirect reciprocity are classified into two types: public 
[5,6,8,9,11,12,14-17,41] and private [7,10,13,17,19] repu- 
tation models. 

In public reputation models, all the players have access 
to a common information source that provides the reputa- 
tion values of the players. Therefore, a donor and observer 
perceive the same reputation of a recipient such that they 
do not suffer from the discrepancy of reputations. In 
public reputation models without group structure of the 
population, ST and JG realize evolutionarily stable coop- 
eration [11,12]. This result is consistent with ours because, 
in the limit 0—^1, Eqs. (14) and (18) are reduced to 
a trivial condition b/c > 1 such that the population of 
discriminators is stable under ST and JG. 

In private reputation models, each player individually 
collects others' reputations such that a reputation of a 
player varies between individuals. In contrast to the case 
of public reputation models, a homogeneous population 
of discriminators is invaded by unconditional cooperators 
in private reputation models. A mixture of discriminators 
and unconditional cooperators is often stable under vari- 
ants of ST [7,10,13,19]. Under variants of JG, a population 
of discriminators is invaded by unconditional defectors 
[17,19] (but see Ref. [13]), or discriminators and uncon- 
ditional cooperators are frequent in an island model if 
dispersal of offspring is confined within each island [10]. 
In the limit 0^0 and M —> oo, our model can be inter- 
preted as a private reputation model. In this situation, the 
population of discriminators is unstable because Eqs. (14) 
and (18) are violated. Therefore, the results obtained from 
our model in this limit are consistent with the previous 
results. 

For intermediate 0 and M values, our model uses a 
public reputation scheme within each group and a pri- 
vate reputation scheme across groups. In this sense, the 
structure of information sharing in our model is situated 
between public and private reputation models. 

One of the present authors previously studied a model 
of ingroup favoritism on the basis of indirect reciprocity 
[41], which we refer to as the multiple standard model. 
The multiple standard model and the model analyzed in 
the present study are different in two aspects. First, in 
the multiple standard model, a given players reputation 
is made public to different groups such that the problem 
of coordination in regard to reputations among different 
groups does not exist. In the present model, observers in 
different groups may differently perceive a players repu- 
tation, which leads to the coordination problem. Second, 
in the multiple standard model, observers are allowed 
to use different rules to assign reputations to ingroup 
and outgroup members. Similarly, donors may use differ- 
ent action selection rules toward ingroup and outgroup 
recipients. Then, ingroup favoritism of different degrees 



emerges. Consider a situation in which the action rule is 
of a single standard such that donors are discriminators 
toward both ingroup and outgroup recipients. Then, at 
most partial ingroup favoritism in which players always 
cooperate with ingroup members and partially (i.e., with 
probability 1 /2) cooperate with outgroup members is evo- 
lutionarily stable. Consider another situation in which 
the action rule is of a double standard such that donors 
are discriminators toward ingroup members and uncon- 
ditional defectors toward outgroup members. Then, per- 
fect ingroup favoritism in which players always cooperate 
with ingroup members and always defect against out- 
group members is evolutionarily stable. In the present 
model, observers use a single-standard reputation assign- 
ment rule, and donors use a single-standard action rule. 
Then, partial ingroup favoritism, but not perfect ingroup 
favoritism, can be evolutionarily stable. 

Group competition models of indirect reciprocity were 
previously studied [15,16]. In references [15,16], the 
authors numerically examined competition between dif- 
ferent assignment rules employed in different groups. In 
our terminology, they assumed that the donation game is 
played inside each group and that reputations are updated 
exclusively by ingroup observers under the public rep- 
utation scheme. They showed that JG (stern-judging in 
their terminology) emerges in the course of evolution- 
ary dynamics based on group competition and individual 
selection. Their models and ours are fundamentally dif- 
ferent although both studies have stressed the importance 
of JG. First, they assumed group competition and we did 
not. Second, they mainly focused on competition between 
different assignment rules and we did not; we only stud- 
ied the special case in which observers in different groups 
adopt either of ST or JG. Third, we determined the possi- 
bility of ingroup favoritism and group-independent coop- 
eration. In contrast, their model is not concerned with 
ingroup favoritism because interaction between a donor 
and recipient in different groups is not assumed. 

Uchida and Sigmund analyzed competition between 
assignment rules by using replicator dynamics [18]. In 
their model, a player selected as donor uses the pub- 
lic information source corresponding to the assignment 
rule that the player adopts. For example, if the surviv- 
ing assignment rules are only ST and JG (SUGDEN and 
KANDORI, respectively, in their terminology), there are 
two public information sources. Although their model is 
apparently a public reputation model, the players can be 
interpreted to belong to one of the groups denned by the 
assignment rule; members in each group share a com- 
mon information source and use the same assignment 
rule. Helping a recipient having a bad reputation in the 
eyes of both ST and JG groups is assessed to be good 
by the ST group and bad by the JG group. Therefore, JG 
players assess ST players to be bad more often than they 
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assess JG players. Because this tendency is strong enough, 
ingroup favoritism occurs in the JG group. Their model 
and ours are consistent with each other because, when dif- 
ferent groups can adopt different assignment rules, both 
their model and ours with sufficiently many groups pre- 
dict bistability between ST and JG. Their model and ours 
complement each other in the following respects. First, 
they investigated competition between assignment rules, 
whereas we mainly studied the case in which all the groups 
share an assignment rule. Second, they assumed a well- 
mixed population, whereas we varied the frequency of 
ingroup and outgroup interactions. Third, they studied 
competition among at most five groups (i.e., five assign- 
ment rules), whereas we assumed a general number of 
groups. 

Conclusion 

To explore the possibility of spontaneous ingroup 
favoritism in indirect reciprocity, we analyzed a social 
dilemma game in a population with group structure. We 
showed that the degree of ingroup bias depends on the 
reputation assignment rule. In particular, considerable 
ingroup favoritism occurs under the so-called JG assign- 
ment rule, whereby observers assign bad reputations to 
players helping bad players. Ingroup favoritism has been 
considered to be an evolutionary outcome [25-27,29,33]. 
The present work supports this general idea. To measure 
the dependency of ingroup bias on the assignment rule in 
behavioral experiments may be an interesting challenge. 

Appendices 

A Numerical methods in the case of the homogeneous 
assignment rule 

We prepare a population of N = 10 3 DISC players divided 
into M groups of equal size. We consider anAfxM repu- 
tation matrix, denoted by R = (r^), where r^t e {G, B, U} 
represents the reputation of player i (1 < i < N) in the 
eyes of the observer in group i (1 < i < M). U rep- 
resents the unknown reputation. We assume that all the 
entries of R are equal to U in the beginning of a run. In 
a one-shot donation game, we randomly select a player i 
as donor. Then, with probability 6/(N/M — 1), we select 
a recipient 7(7^ /) that is in the donors group. With prob- 
ability (1 — 0)/ (N — N/M), we select a recipient j that is 
in a group different from the donors group. When deter- 
mining the action, the donor refers to rjj a where k is 
the donors group. We assume that the donor cooperates 
when rj t k = U. After the game, the observer in each group 
^ (1 < £ < M) assigns a new reputation to donor i such 
that Tii — G with probability Og^^) an d Ti,t = B 
with probability 1 — Og(<2, r//), where a e {C, D} is the 
donors action and Og(A rjj) under each assignment rule 
is defined in Table 2. When rjj = U, we assume that the 



observer uses IM; Og(U, C) = 1 — /x and Og(U, D) = /x. 
We set fi = 0.01. 

After repeating T = 10 5 rounds of the donation game, 
we calculate the fraction of G players in group k in 
the eyes of the observer in group I, which is given 
byO*,(G) = Zti; player /in group k 8(r u )/(N/M), where 
8(G) = 1 and 8(B) = 8(U) = 0. The fractions of G 
players in the eyes of ingroup and outgroup observers 
are given by 0* n (G) = Y*=i ®t,k^l M and °out(G) = 
EtiEtu^^(G)/[M(M - 1)], respectively. By 
substituting these quantities in Eqs. (9) and (10), we obtain 
xjs and p. We average xj/ and p over 10 2 runs of the 
simulation. 

B Numerical methods in the case of the heterogeneous 
assignment rule 

To analyze heterogeneous populations, we assume that 
observers in groups 1, 2, • • • , m adopt JG and those in 
groups m + 1, m+2, • • • ,M, adopt ST. By applying the pro- 
cedure explained in Appendix A, we obtain the fraction of 
G players in group k in the eyes of the observer in group I, 
i.e., O^(G). The probability that a donor in group k helps 
a recipient is given by 

1 M 

fk = e^l k{G) + { i- e) --- J2 *k(G). (19) 

t=\jL±k 

The probability that a recipient in group k is helped by a 
donor is given by 

1 M 

^ = 0^1^)^(1-0)--- J2 *k(G). (20) 

The ingroup bias of the players in group k is given by 
1 M 

Pk = nk(G) -—— £ o*,(G). (21) 

t=\JL±k 

The payoff to the players in group k is given by 

7T k = -cxj/ k + b(p k . (22) 

The cooperativeness, ingroup bias, and payoff to the 
players in groups employing JG and ST are defined by 
QjG = E*Li Qk/m and Qst = Y,f= m +i QkW - m), 
respectively, where Q represents either xjr, p, or jr. We 
average these quantities over 10 2 runs for each parameter 
set to generate Figure 7. 
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